Korean named entity recognition based on language-specific features

نویسندگان

چکیده

Abstract In this paper, we propose a novel way of improving named entity recognition (NER) in the Korean language using its language-specific features. While field NER has been studied extensively recent years, mechanism efficiently recognizing entities (NEs) hardly explored. This is because distinct linguistic properties that present challenges for modeling. Therefore, an annotation scheme corpora by adopting CoNLL-U format, which decomposes words into morphemes and reduces ambiguity NEs original segmentation may contain functional such as postpositions particles, proposed herein. We investigate how NE tags are best represented morpheme-based implement algorithm to convert word-based syllable-based with format. Analyses results traditional neural models reveal format feasible, varied performances under influence various additional features demonstrated. Extrinsic conditions were also considered observe variance models, given different types data, including tagging formats.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Novel Approach to Conditional Random Field-based Named Entity Recognition using Persian Specific Features

Named Entity Recognition is an information extraction technique that identifies name entities in a text. Three popular methods have been conventionally used namely: rule-based, machine-learning-based and hybrid of them to extract named entities from a text. Machine-learning-based methods have good performance in the Persian language if they are trained with good features. To get good performanc...

متن کامل

Named entity recognition: Exploring features

We study a comprehensive set of features used in supervised named entity recognition. We explore various combinations of features and compare their impact on recognition performance. We build a conditional random field based system that achieves 91.02% F1-measure on the CoNLL 2003 (Sang and Meulder, 2003) dataset and 81.4% F1-measure on the OntoNotes version 4 (Hovy et al., 2006) CNN dataset, w...

متن کامل

Using Language Independent and Language Specific Features to Enhance Arabic Named Entity Recognition

The Named entity recognition task has been garnering significant attention as it has been shown to help improve the performance of many natural language processing applications. More recently, we are starting to see a surge in developing named entity recognition systems for languages other than English. With the relative abundance of resources for the Arabic language and a certain degree of mat...

متن کامل

Features for Named Entity Recognition in Czech Language

This paper deals with Named Entity Recognition (NER). Our work focuses on the application for the Czech News Agency (ČTK). We propose and implement a Czech NER system that facilitates the data searching from the ČTK text news databases. The choice of the feature set is crucial for the NER task. The main contribution of this work is thus to propose and evaluate some different features for the na...

متن کامل

Language Independent Named Entity Recognition

The role of Internet in personal, economic and political advancement is growing in a fast pace. By the turn of century, data on web reaches to petabytes or exabytes or may even scale up-to unimaginable quantities. Extraction of precise and structured information from such large amounts of unstructured or semi-structured data is the major concern of web known as Information Extraction. Named ent...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Natural Language Engineering

سال: 2023

ISSN: ['1469-8110', '1351-3249']

DOI: https://doi.org/10.1017/s1351324923000311